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Mosaic filter multi-spectral imaging 

Abstract 

Multi-spectral imaging will be done using a solid-state detector array (e.g. a CCD), a 
mosaic filter mask and simple collection optics. 

Introduction 

A solid-state detector chip, either a CCD or CMOS, merely functions as a photon 
counter. The process of defining physical parameters that influence which photons are 
actually counted broadly defines spectroscopy. Imaging can also be done if spatial 
information is preserved. To accomplish this, an ordered array of pixel-sized filters can 
mask the CCD or CMOS chip. These filters will define which photons will be detected. 
With sufficient resolution, this filter mosaic will be binned in a 2 x 2 or 3 x 3 (or higher 
order) matrix, allowing 4 or 9 (or more) optical bands respectively. Essentially, 3- 
dimensions of information will be derived from a 2-dimensional layout of pixels. The 
binned pixels provide the 3 rd dimension spectral information, while the binned groups 
define the x and y position. 

On-chip spectroscopy 

When optical filters of varying known properties are spatially distributed in an ordered 
fashion, a great deal of information can be gained. This process can very specifically 
define which photons reach the detector at which exact location. By accounting for the 
various pixels of the chip and by binning them according to a specific color scheme, 
specific spectroscopic information can be gathered in a very simplistic manner. This 
concept is currently in use for color CCD video chips. By increasing the number of color 
bands recorded, from the 2 x 2 Cy, G, Ye and Mg to 9 bands, in a 3 x 3 binning matrix or 
beyond, precise spectroscopic values can be derived with a reasonable spatial 
representation. This is graphically represented below. 
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The spectral response for the effective RGB image is achieved through the standard cyan, 
green, yellow and magenta filter dyes as represented below. 
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The remaining bands could have customized spectral signatures, for example peaks that 
could have their maxima correlate to those of specific compounds. In the following 
example, Bands 1 to 5 correlate to compounds used to spectroscopically detect cancer 
and pre cancer in the cervix. 

Band 1: 390 nm ± 10 nm, Collagen 

Band 2: 410 nm ± 10 nm, Elastin And Oxy-Hemoglobin 

Band 3: 545 nm ±10 nm, Oxy-Hemoglobin 

Band 4: 580 nm ± 10 nm, Oxy-Hemoglobin 

Band 5: 635 nm ± 10 nm, PP IX (ALA) 
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The 3x3 binning represents one spatial "pixel," an 8 x 10 array of which is shown 
below. Spatially, this chip has 80 "pixels", while the actual chip would have 720 pixels 
when using a 3 x 3 binning mode. Modern CCD chips have as many as several Megs of 
pixels. Since the actual chip pixel size is on the order of 5 (im or below, reasonable 
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spatial resolution will still be retained. With the appropriate filter mosaic, the spatial 
resolution would still equal that of a several 100,000 pixel gray-scale chip with "pixel" 
sizes of 15 |Lim or less. 



The photons that pass through the filter mosaic will be of a very specific wavelength. 
The unfortunate aspect of this technique is the loss of signal. 1/9 of the photons would 
reach the detector to do spectroscopy, if their energy matches the spectroscopic bands 
being looked at. Using high QE CCD chips and minimizing collection optics, the best 
system QE would still be under 5%. 

Filter Mosaic Technology 

This technology is dependent on the ability to manufacture a filter mosaic in the 
appropriate size dimension to effectively overlay and match the pixels of the chip, which 
is on the order of 5 |xm. The general dye techniques used for RGB filters produce bands 
too broad to allow for highly resolved spectroscopy (see spectra above), while still 
appropriate for the spotting camera function of the chip. The filter resolution will come 
from uniformly dispersed discretely sized nanometer polystyrene spheres that will 
produce narrow optical windows through which only photons of very specific energies 
can travel. The concept utilizes the particle nature of light in that a specific wavelength 
and certain harmonics can physically pass through an ordered array of particles, as is 
shown in the diagram. Other wavelengths are physically blocked and higher harmonics 
can be blocked by a bandpass filter. 
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In the diagram, if the desired transmission wavelength is 400 nm, for example, the 
particle diameter, d, plus the inter-particle length, /, must equal half the desired 
wavelength, 200 nm. Adjusting d and the optically clear surfactant lengths 1/2, will 
determine the band width of the optical filter. A larger / will produce a wider band. 

By utilizing current lithographic microchip manufacturing processes, effective masking 
can be achieved to allow for filter construction. 



Polystyrene nanoparticles 

Uniform polystyrene spheres can be synthesized from its molecular precursors by 
creating a single mass nucleation event in a solution, and then terminating growth by 
temperature or surfactant manipulation at a later defined time. The particles can retain 
their solubility through organic functionalization. This would then allow for their 
solubility in a resist for transport to the filter construction. The functionalization chain 
length would also define the inter-particle distance, thereby influencing the resolution of 
the passable optical band. Once the resist has been deposited in its appropriate location, 
subsequent drying would cause a dense close packed array of the spheres, again with the 
spacing determined by the surfactant molecules used for functionalization. 
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